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Abstract 

The  operation  of  a  human  organization  requires  dozens  of  ev¬ 
eryday  tasks  to  ensure  coherence  in  organizational  activities, 
to  monitor  the  status  of  such  activities,  to  gather  information 
relevant  to  the  organization,  to  keep  everyone  in  the  organiza¬ 
tion  informed,  etc.  Teams  of  software  agents  can  aid  humans 
in  accomplishing  these  tasks,  facilitating  the  organization’s 
coherent  functioning  and  rapid  response  to  crises,  while  re¬ 
ducing  the  burden  on  humans.  Based  on  this  vision,  this  paper 
reports  on  Electric  Elves,  a  system  that  has  been  operational, 
24/7,  at  our  research  institute  since  June  1,  2000. 

Tied  to  individual  user  workstations,  fax  machines,  voice, 
mobile  devices  such  as  cell  phones  and  palm  pilots.  Electric 
Elves  has  assisted  us  in  routine  tasks,  such  as  rescheduling 
meetings,  selecting  presenters  for  research  meetings,  track¬ 
ing  people’s  locations,  organizing  lunch  meetings,  etc.  We 
discuss  the  underlying  AI  technologies  that  led  to  the  success 
of  Electric  Elves,  including  technologies  devoted  to  agent- 
human  interactions,  agent  coordination,  accessing  multiple 
heterogeneous  information  sources,  dynamic  assignment  of 
organizational  tasks,  and  deriving  information  about  organi¬ 
zation  members.  We  also  report  the  results  of  deploying  Elec¬ 
tric  Elves  in  our  own  research  organization. 

Introduction 

Many  activities  of  a  human  organization  are  well-suited  for 
software  agents,  which  can  devote  significant  resources  to 
perform  these  tasks,  thus  reducing  the  burden  on  humans. 
Indeed,  teams  of  such  software  agents  could  assist  all  orga¬ 
nizations,  including  disaster  response  organizations,  corpo¬ 
rations,  the  military,  universities  and  research  institutions. 

The  operation  of  a  human  organization  involves  dozens 
of  critical  everyday  tasks  to  ensure  coherence  in  organiza¬ 
tional  activities,  to  monitor  the  status  of  such  activities,  to 
obtain  information  relevant  to  the  organization,  to  keep  ev¬ 
eryone  in  the  organization  informed,  etc.  These  activities  are 
often  well  suited  for  software  agents,  which  can  devote  sig¬ 
nificant  resources  to  perform  these  tasks,  thus  reducing  the 
burden  on  humans.  Indeed,  teams  of  such  software  agents, 
including  proxy  agents  that  act  on  behalf  of  humans,  would 
enable  organizations  to  act  coherently,  to  attain  their  mis¬ 
sion  goals  robustly,  to  react  to  crises  swiftly,  and  to  adapt 
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to  events  dynamically.  Such  agent  teams  could  assist  all  or¬ 
ganizations,  including  the  military,  civilian  disaster  response 
organizations,  corporations,  and  universities  and  research  in¬ 
stitutions. 

Within  an  organization,  we  envision  agents  assisting 
in  all  of  its  day-to-day  functioning.  For  a  research  in¬ 
stitution,  agents  may  facilitate  activities  such  as  meeting 
(re)scheduling,  selecting  presenters  for  research  meetings, 
composing  papers,  developing  software  and  deploying  peo¬ 
ple  and  equipment  for  out-of-town  demonstrations.  For 
a  disaster  response  organization,  agents  may  facilitate  the 
teaming  of  people  and  equipment  to  rapidly  respond  to  crises 
(e.g.,  earthquakes),  to  monitor  the  progress  of  any  such  for 
rapid  response,  etc.  To  accomplish  such  goals,  each  person 
in  an  organization  will  have  an  agent  proxy.  For  instance, 
if  an  organizational  crisis  requires  an  urgent  deployment  of 
a  team  of  people  and  equipment,  then  agent  proxies  could 
dynamically  volunteer  for  team  membership  on  behalf  of 
the  people  or  resources  they  represent,  while  also  ensuring 
that  the  selected  team  coljlectively  possesses  sufficient  re¬ 
sources  and  capabilities.  The  proxies  must  also  manage  effi¬ 
cient  transportation  of  such  resources,  the  monitoring  of  the 
progress  of  individual  participants  and  of  the  mission  as  a 
whole,  and  the  execution  of  corrective  actions  when  goals 
appear  to  be  endangered. 

Based  on  the  above  vision,  we  have  developed  a  system 
called  Electric  Elves  that  applies  agent  technology  in  ser¬ 
vice  of  the  day-to-day  activities  of  the  Intelligent  Systems 
Division  of  USC/ISI.  Electric  Elves  is  a  system  of  about 
15  agents,  including  nine  proxies  for  nine  people,  plus  two 
different  matchmakers,  one  flight  tracker  and  one  scheduler 
running  continuously  for  past  several  months.  This  paper 
discusses  the  tasks  performed  by  the  system,  the  research 
challenges  it  faced  and  its  use  of  AI  technology  in  overcom¬ 
ing  those  challenges. 

One  key  contribution  of  this  paper  is  outlining  the  chal¬ 
lenges  faced  in  deploying  agents  to  support  organizations. 
In  particular,  the  complexity  inherent  in  human  organiza¬ 
tions  complicates  all  of  the  tasks  agents  must  perform.  Eirst, 
since  agents  must  interact  with  humans,  issues  of  adjustable 
autonomy  become  critical.  In  particular,  agents  acting  as 
proxies  for  people  must  automatically  adjust  their  own  au¬ 
tonomy,  e.g.,  avoiding  critical  errors,  possibly  by  letting 
people  make  important  decisions  while  autonomously  mak- 
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ing  the  more  routine  decisions.  Second,  to  accomplish  their 
goals,  agents  must  be  provided  reliable  access  to  informa¬ 
tion.  Third,  people  have  a  variety  of  capabilities,  interests, 
preferences  and  engage  in  many  different  tasks.  To  enable 
teaming  among  such  people  for  crisis  response  or  other  or¬ 
ganizational  tasks,  agents  acting  as  their  proxies  must  rep¬ 
resent  and  reason  with  such  capabilities  and  interests.  We 
thus  require  powerful  matchmaking  capabilities  to  match 
both  interests  and  capabilities.  Fourth,  coordination  of  all 
of  these  different  agents,  including  proxies,  is  itself  a  sig¬ 
nificant  research  challenge.  Finally,  the  entire  agent  system 
must  scale-up:  (i)  it  must  scale-up  in  the  sense  of  running 
continually  24  hours  a  day  7  days  a  week  (24/7)  for  months 
at  a  time;  (ii)  it  must  scale-up  in  the  number  of  agents  to 
support  large-scale  human  organizations. 

The  Electric  Elves 

In  any  organization  that  are  dozens  of  small  mundane  tasks 
that  every  individual  performs  on  a  daily  basis,  such  as 
scheduling  meetings,  arranging  lunch,  locating  other  peo¬ 
ple,  etc.  Many  of  these  tasks  require  looking  up  informa¬ 
tion,  monitoring  information,  and  keeping  people  informed. 
As  such,  they  are  well  suited  to  software  agents,  which  can 
devote  the  resources  to  perform  these  tasks  in  a  way  that 
would  be  impractical  for  people  to  perform  them.  For  exam¬ 
ple,  most  people  would  consider  it  unreasonable  to  ask  their 
secretary  to  check  their  flight  every  few  minutes  to  see  if  it 
is  delayed  or  to  monitor  their  current  GPS  location  to  ensure 
that  they  will  arrive  in  time  for  the  Sam  meeting.  However, 
we  have  the  resources  and  technology  today  to  give  every¬ 
one  their  own  personal  agents  to  help  with  these  everyday 
tasks. 

In  the  Electric  Elves  project,  we  have  developed  technol¬ 
ogy  and  tools  for  deploying  agents  into  human  organizations 
to  help  with  organizational  tasks.  We  describe  the  applica¬ 
tion  of  the  Electric  Elves  to  two  classes  of  tasks.  Eirst,  we 
describe  the  problem  of  coordinating  activities  within  an  in¬ 
dividual  research  project.  These  tasks  must  be  tightly  coor¬ 
dinated  and  a  significant  amount  of  information  is  known  in 
advance  about  the  participants  and  their  goals  and  capabili¬ 
ties.  Second,  in  order  to  demonstrate  the  capabilities  of  the 
system  in  a  more  open  environment,  we  applied  the  system 
to  the  problem  of  meeting  planning  with  participants  outside 
the  organization  where  some  of  the  necessary  information 
about  participants  is  not  known  in  advance. 

Coordinating  Project  Activities 

Our  agents  help  coordinate  the 
everyday  activities  of  a  research 
project:  they  keep  the  project 
running  smoothly,  rescheduling 
meetings  when  someone  is  de¬ 
layed,  ordering  food  for  meet¬ 
ings  or  if  someone  has  to  work 
late,  and  identifying  speakers  for 
research  meetings.  Each  person 
in  the  project  is  assigned  his  or 
her  own  personal  proxy  agent, 
which  represents  that  person  to  the  agent  system. 


A  proxy  agent  keeps  track  of  a  project  member’s  cur¬ 
rent  location  using  several  different  information  sources,  in¬ 
cluding  their  calendar.  Global  Position  System  (GPS)  device 
when  outside  of  the  building  (Pig.  1),  infrared  communica¬ 
tions  within  the  building,  and  computer  activity.  When  a 
proxy  agent  notices  that  someone  is  not  attending  a  sched¬ 
uled  meeting  or  that  they  are  too  far  away  to  make  it  to  a 
scheduled  meeting  in  time,  it  springs  into  action.  Their  agent 
sends  them  a  message  using  a  wireless  device  (i.e.,  a  cell 
phone  or  Palm  Pilot)  asking  if  they  want  to  cancel  the  meet¬ 
ing,  delay  the  meeting,  or  have  the  meeting  proceed  without 
them.  If  a  user  responds,  their  decision  is  communicated 
to  the  other  participants  of  the  scheduled  meeting.  If  they 
are  unable  to  respond,  the  agent  must  make  a  decision  au¬ 
tonomously. 

Por  weekly  project  meetings,  the  agents  coordinate  the 
selection  of  the  presenter  and  arrange  food  for  the  meetings. 
Once  a  week  an  auction  is  held  where  all  of  the  meeting  par¬ 
ticipants  are  asked  about  their  capability  and  willingness  to 
present  at  the  next  meeting.  Then  the  system  compiles  the 
bids,  selects  a  presenter,  and  notifies  all  of  the  attendees  who 
will  be  presenting  at  the  next  project  meeting.  The  agents 
also  arrange  food  for  lunch  meetings.  They  order  from  a  set 
of  nearby  restaurants,  select  meals  that  were  highly  rated  by 
others,  and  fax  the  orders  directly  to  the  restaurant  with  in¬ 
structions  for  delivery.  We  have  begun  relying  on  our  agents 
so  heavily  to  order  lunch  that  one  local  “Subway”  restau¬ 
rant  owner  even  remarked:  “. . .  more  and  more  computers 
are  getting  to  order  food. . .  so  we  might  have  to  think  about 
marketing  [to  them].” 

When  a  visitor  is  coming  to  visit  a  project,  the  agents 
monitor  the  flight  that  the  person  is  arriving  on.  If  a  visi¬ 
tor  is  arriving  the  same  day  of  the  meeting,  the  agents  track 
their  flight  status  and  send  a  notification  once  the  visitor  ar¬ 
rives.  If  they  are  late,  the  agents  will  delay  the  scheduled 
meetings.  If  they  are  arriving  the  day  before  a  visit,  then  the 
agents  will  send  a  welcome  fax  to  the  hotel  where  the  visitor 
is  staying  with  a  list  of  highly  rated  restaurants  nearby.  Some 
of  the  technical  challenges  in  building  this  application  are  in 
determining  how  much  autonomy  the  agents  should  assume 
on  behalf  of  the  user,  dynamically  building  agent  teams,  de¬ 
termining  how  to  assign  the  organizational  tasks  (e.g.,  pre¬ 
sentations),  and  providing  access  to  online  data  such  as  cal¬ 
endars  and  restaurants. 

Organizing  External  Meetings 

To  demonstrate  how  the  technology  supports  less  structured 
environments,  we  also  applied  the  Electric  Elves  to  the  task 
of  planning  and  coordinating  ad  hoc  meetings  at  confer¬ 
ences  and  workshops  involving  individuals  across  different 
organizations.  The  system  identifies  people  that  have  simi¬ 
lar  research  interests,  coordinates  scheduling  a  meeting  with 
those  people,  locates  a  suitable  restaurant  for  a  meeting  that 
takes  into  account  dietary  constraints,  and  makes  a  reserva¬ 
tion  using  an  online  reservation  service. 

To  identify  individuals  with  related  interests,  the  agents 
use  an  online  bibliography  service  that  provides  a  list  of  the 
papers  written  by  an  individual.  When  a  person  is  going  to  a 
meeting,  their  agent  can  check  an  online  source  to  locate  in- 


Eigure  1:  A  Palm  VII 
PDA  with  GPS  receiver 


dividuals  going  to  the  same  meeting  and  then  build  a  model 
of  the  research  interests  of  the  different  participants  based 
on  their  publications.  Using  this  information,  the  user  se¬ 
lects  the  participants  for  the  meeting  and  the  agent  sends  out 
an  invitation  to  each  of  the  potential  attendees.  If  they  are 
part  of  the  Electric  Elves  network,  the  invitation  is  sent  to 
their  own  agent.  Otherwise  the  invitation  is  sent  via  fax  or 
email  with  instructions  on  how  to  confirm  (or  decline)  the 
meeting. 

Once  the  agent  has  finalized  the  set  of  participants  for  a 
meeting,  it  selects  an  appropriate  place  to  have  the  meeting. 
It  does  this  by  checking  for  any  known  dietary  restrictions 
and  uses  that  information  to  identify  suitable  cuisine  types. 
Next,  the  agent  goes  out  to  an  online  restaurant  reservation 
site  to  find  the  set  of  restaurants  closest  to  the  given  location 
and  matches  up  these  restaurants  with  a  restaurant  review 
site  to  select  the  high-quality  restaurants.  The  user  selects 
from  a  small  set  of  close,  recommended  restaurants  and  the 
agent  then  makes  a  reservation  for  the  meeting  using  the  on¬ 
line  reservation  system. 

This  application  highlights  two  additional  technical  chal¬ 
lenges:  gathering  information  about  people  from  other  orga¬ 
nizations  and  ensuring  the  robustness  of  the  interaction  with 
online  sources  that  change  frequently. 

Underlying  Technologies 

In  this  section  we  describe  how  we  addressed  some  of  the 
technical  challenges,  namely  the  issues  of  interacting  with 
human  users  within  an  organization,  providing  reliable  ac¬ 
cess  to  organization-related  data,  dynamic  assignment  of 
organizational  tasks,  deriving  knowledge  about  the  partici¬ 
pants  in  an  organization,  and  coordination  of  agent  teams. 

Agent  Interactions  with  Human  Users 

Electric  Elves  agents  must  often  act  on  behalf  of  the  hu¬ 
man  users.  Specifically,  a  user’s  agent  proxy  (named  “Eri- 
day”  after  Robinson  Crusoe’s  servant  and  companion)  can 
take  autonomous  actions  to  coordinate  collaborative  activi¬ 
ties  (e.g.,  meetings).  Eriday’s  decision  making  on  behalf  of 
a  person  naturally  leads  to  the  issue  of  adjustable  autonomy. 
An  agent  has  the  option  of  acting  with  full  autonomy  (e.g., 
delaying  a  meeting,  volunteering  the  user  to  give  a  presenta¬ 
tion,  ordering  a  meal).  On  the  other  hand,  it  may  act  without 
autonomy,  instead  asking  its  user  what  to  do.  Clearly,  the 
more  decisions  that  Eriday  makes  autonomously,  the  more 
time  and  effort  it  saves  its  user.  Yet,  given  the  high  uncer¬ 
tainty  in  Eriday’s  knowledge  of  its  user’s  state  and  prefer¬ 
ences,  it  could  potentially  make  very  costly  mistakes  while 
acting  autonomously.  Eor  example,  it  may  order  an  expen¬ 
sive  dinner  when  the  user  is  not  hungry,  or  volunteer  a  busy 
user  to  give  a  presentation.  Thus,  each  Eriday  must  make  in¬ 
telligent  decisions  about  when  to  consult  its  user  and  when 
to  act  autonomously. 

Our  initial  attempt  at  adjustable  autonomy  was  inspired 
by  CAP  (Mitchell  et  al.  1994),  an  agent  system  for  advising 
a  user  on  scheduling  meetings.  As  with  CAP,  each  Eriday 
tried  to  learn  its  user  preferences  using  decision  trees  under 
C4.5  (Quinlan  1993).  One  problem  became  apparent  when 


applying  this  technique  in  Electric  Elves:  a  user  would  not 
grant  autonomy  to  Eriday  in  making  certain  decisions,  but 
s/he  would  sometimes  be  unavailable  to  provide  any  input  at 
decision  time.  Thus,  a  Eriday  could  end  up  waiting  indefi¬ 
nitely  for  user  input  and  not  coordinate  with  its  teammates. 
We  therefore  modified  the  system  so  that  if  a  user  did  not  re¬ 
spond  within  a  fixed  time  limit,  Eriday  acted  autonomously 
based  on  its  learned  decision  tree.  Unfortunately,  when  we 
deployed  the  system  in  our  research  group,  it  led  to  some 
dramatic  failures.  Eor  instance,  one  user’s  proxy  erroneously 
volunteered  him  to  give  a  presentation.  C4.5  had  over  gen¬ 
eralized  from  a  few  examples  to  create  an  incorrect  rule.  Al¬ 
though  Eriday  tried  asking  the  user  at  first,  because  of  the 
timeout,  it  had  to  eventually  follow  the  incorrect  rule  and 
take  the  undesirable  autonomous  action. 

It  was  clear,  based  on  this  experience,  that  the  team  con¬ 
text  in  Electric  Elves  would  cause  difficulties  for  existing 
adjustable-autonomy  techniques  (Dorais  et  al.  1998;  Eergu- 
son,  Allen,  &  Miller  1996;  Mitchell  et  al.  1994)  that  fo¬ 
cused  on  solely  individual  human-agent  interactions.  There¬ 
fore,  we  developed  a  novel,  decision-theoretic  planning  ap¬ 
proach  that  used  Markov  Decision  Processes  (MDPs)  (Put- 
erman  1994)  to  support  explicit  reasoning  about  team  co¬ 
ordination.  The  MDPs  used  in  our  framework  (Scerri,  Py- 
nadath,  &  Tambe  2001)  provide  Eriday  with  a  novel  three- 
step  approach  to  adjustable  autonomy:  (i)  Before  transfer¬ 
ring  decision-making  control,  an  agent  explicitly  weighs  the 
cost  of  waiting  for  user  input  and  any  potential  team  misco- 
ordination  against  the  likelihood  and  cost  of  erroneous  au¬ 
tonomous  action;  (ii)  When  transferring  control,  an  agent 
does  not  rigidly  commit  to  this  decision,  but  it  instead 
flexibly  reevaluates  when  its  user  does  not  respond,  some¬ 
times  reversing  its  decision  and  taking  back  autonomy;  (iii) 
Rather  than  force  a  risky  decision  in  situations  requiring  au¬ 
tonomous  action,  an  agent  changes  its  coordination  arrange¬ 
ments  by  postponing  or  reordering  activities  to  potentially 
buy  time  to  lower  decision  cost/uncertainty.  Since  these 
coordination  decisions  and  actions  incur  varying  costs  and 
benefits  over  time,  agents  look  ahead  over  the  different  se¬ 
quences  of  possible  actions  and  plan  a  policy  that  maximizes 
team  welfare. 

The  agent  follows  the  first  step  of  our  approach  through 
team-related  components  within  its  MDP  model  of  the  costs 
and  benefits  of  its  available  actions.  Thus,  the  MDP’s 
decision-theoretic  selection  of  optimal  policies  balances  in¬ 
dividual  preferences  against  the  team’s  needs.  The  policies 
generated  from  the  MDP  support  the  second  step  of  our  ap¬ 
proach  by  providing  the  necessary  flexibility  and  responsive¬ 
ness  in  autonomy  decisions.  The  agent  can  immediately  re¬ 
spond  to  any  change  of  state  by  following  the  policy’s  spec¬ 
ified  action  for  the  new  state.  The  agent’s  decision  making 
is  an  ongoing  process  rather  than  a  single  decision,  as  the 
agent  acts  according  to  its  MDP  policy  throughout  the  entire 
sequence  of  states  it  finds  itself  in.  We  achieve  the  third  step 
of  our  approach  by  having  each  agent  consider  the  different 
costs,  both  present  and  future,  of  team  miscoordination  vs. 
erroneous  actions.  In  the  meeting  scenario,  changes  in  co¬ 
ordination  are  essentially  delaying  actions.  Such  changes  in 
coordination  could,  among  other  things,  buy  time  to  reduce 


the  uncertainty  or  cost.  MDPs  are  especially  suitable  for 
producing  such  a  plan  because  they  generate  policies  while 
looking  ahead  at  all  of  the  possible  outcomes. 

We  have  implemented  MDPs  that  model  Friday’s  deci¬ 
sions  on  meeting  rescheduling,  volunteering  its  user  to  give 
a  presentation,  and  selecting  which  user  should  give  a  pre¬ 
sentation.  For  instance,  consider  one  possible  policy,  gen¬ 
erated  from  an  MDP  for  the  rescheduling  of  meetings.  If 
the  user  has  not  arrived  at  the  meeting  five  minutes  prior  to 
its  scheduled  start,  this  policy  specifies  “ask  the  user  what 
to  do”.  If  the  user  does  not  arrive  by  the  time  of  the  meet¬ 
ing,  the  policy  specifies  “wait”,  so  the  agent  continues  acting 
without  autonomy.  However,  if  the  user  still  has  not  arrived 
five  minutes  after  the  meeting  is  scheduled  to  start,  then  the 
policy  chooses  “delay  by  15  minutes”,  which  the  agent  then 
executes  autonomously. 

In  the  future,  we  plan  to  apply  our  MDP-based  framework 
to  other  decisions  (currently  performed  without  any  auton¬ 
omy)  within  Electric  Elves,  such  as  ordering  meals,  accept¬ 
ing  meeting  invitations,  and  selecting  restaurants.  In  addi¬ 
tion,  the  current  MDP  framework  supports  some  learning  of 
likelihoods  (e.g.,  the  probability  that  the  user  will  arrive  to 
the  meeting  on  time),  but  we  are  planning  to  extend  the  role 
of  learning  to  allow  further  personalization. 

Flexible  Assignment  of  Tasks 

The  human  agents  and  software  agents  in  our  organization 
perform  a  variety  of  tasks  that  are  often  interrelated.  Agents 
often  need  to  delegate  a  subtask  to  another  agent  capable 
of  performing  it  (e.g.,  reserve  a  meeting  room),  invoke  an¬ 
other  agent  to  gather  and  report  back  necessary  information 
(e.g.,  find  the  location  of  a  person),  or  rely  on  another  agent 
to  execute  some  task  in  the  real  world  (e.g.,  attend  a  lunch 
meeting).  Simple  agent  matchmaking  is  sufficient  in  many 
multi-agent  systems  where  agents  perform  one  (or  at  most  a 
few)  kind  of  task,  and  their  capabilities  are  designed  by  the 
system  developers  to  fit  the  interactions  anticipated  among 
the  agents.  In  contrast,  our  agents  are  complex  and  heteroge¬ 
neous,  and  the  agents  that  issue  a  request  cannot  be  expected 
to  be  aware  of  what  other  agents  are  available  and  how  they 
are  invoked. 

We  have  developed  an  agent  matchmaker  called  PHOS¬ 
PHORUS  (Gil  &  Ramachandran  2001),  which  builds  on 
previous  research  on  matching  problem  solving  goals  and 
methods  in  EXPECT  (Swartout  &  Gil  1995;  Gil  &  Gonzalez 
1996).  The  main  features  of  this  approach  are:  1)  a  declara¬ 
tive  language  to  express  task  descriptions  that  includes  rich 
parameter  type  expressions  to  qualify  task  types;  2)  task  de¬ 
scriptions  are  fully  translated  into  description  logic  to  de¬ 
termine  subsumption  relations  among  tasks;  3)  task  descrip¬ 
tions  are  expressed  in  terms  of  domain  ontologies,  which 
provide  a  basis  for  relating  and  reasoning  about  different 
tasks  and  enables  reformulation  of  tasks  into  subtasks. 

Agent  capabilities  and  requests  are  represented  as  verb 
clauses  with  typed  arguments  (as  in  a  case  grammar),  where 
each  argument  has  a  name  (usually  a  preposition)  and  a  pa¬ 
rameter.  The  type  of  a  parameter  may  be  a  specific  instance, 
an  abstract  concept  (marked  with  spec-of),  an  instance  type 
(marked  with  inst-of),  and  extensional  or  intensional  sets  of 


those  three  types.  Here  are  some  examples  of  capabilities  of 
some  researchers  and  project  assistants; 

“agents  that  can  discuss  Phosphorus” 

((capability  (discuss  (obj  Phosphorus-project))) 

(agents  (gil  surya  chaiupsky  russ))) 

“agents  that  can  setup  an  LCD  projector  in  a  meeting  room” 

((capability  (setup  (obj  (?v  is  (inst-of  Icd-projector))) 

(in  (?r  is  (inst-of  meeting-room))))) 

(agents  (itice))) 

Requests  are  formulated  in  the  same  language,  and  can 
ask  about  general  types  of  instances  (e.g.,  what  agents  can 
setup  any  kind  of  equipment  for  giving  research  presenta¬ 
tions  in  a  meeting  room). 

Description  logic  and  subsumption  reasoning  are  used  to 
relate  different  task  descriptions.  Both  requests  and  agent 
capabilities  are  translated  into  Loom  (MacGregor  1991). 
Loom’s  classifier  recognizes  that  the  capability  to  “setup 
equipment”  will  subsume  one  to  “setup  LCD  projector”,  be¬ 
cause  according  to  the  domain  ontologies  equipment  sub¬ 
sumes  LCD  projector. 

PHOSPHORUS  performs  task  reformulation  when  there 
are  no  agents  with  capabilities  that  subsume  a  request.  In 
that  case,  it  may  be  possible  to  fulfill  the  request  by  decom¬ 
posing  it  into  subtasks.  This  allows  a  more  flexible  matching 
than  if  one  required  a  single  agent  to  match  all  capabilities 
in  the  request.  PHOSPHORUS  supports  set  reformulation 
(breaking  down  a  task  on  a  set  into  its  individual  elements) 
and  covering  reformulation  (decomposing  a  task  into  the  dis¬ 
joint  subclasses  of  its  arguments).  Eor  example,  no  single 
agent  can  discuss  the  entire  Electric  Elves  project,  since  no 
single  researcher  is  involved  in  all  the  aspects  of  the  project. 
However,  PHOSPHORUS  can  return  a  set  of  people  who 
can  collectively  cover  the  topic  based  on  the  subprojects; 

(COVERING  -name  ARIADNE-PROJECT 

-matches  KNOBLOCK  MINTON  LERMAN 
-name  PHOSPHORUS-PROJECT 

-matches  GIL  SURYA  CHALUPSKY  RUSS 
-name  TEAMCORE-PROJECT 
-matches 

(COVERING 

-name  ADJUSTABLE-AUTONOMY-PROJECT 
-matches  TAMBE  SCERRI  PYNADATH 
-name  TEAMWORK-PROJECT 

-matches  TAMBE  PYNADATH  MODI) 
-name  ROSETTA- PROJECT 

-matches  GIL  CHALUPSKY) 

This  example  shows  our  flexibility:  the  requesting  agent 
did  not  need  to  be  aware  of  the  details  of  the  Electric  Elves 
project,  but  still  gets  from  the  reply  subsets  of  agents  that  are 
able  to  fulfill  complementary  parts  of  the  request. 

The  SHADE  matchmaker  (McQuire  et  al.  1993)  also 
matched  agent  capabilities  using  logic  descriptions,  but  the 
basic  matching  operation  was  done  by  unification  and  did 
not  exploit  domain  ontologies  to  relate  different  terms.  In 
RETSINA  (Sycara  et  al.  1999),  description  logic  are  used 
only  to  match  the  parameters  of  the  capability  descriptions, 
while  PHOSPHORUS  translates  the  entire  expression  for  a 
more  thorough  match. 


Many  additional  challenges  lay  ahead  regarding  capabil¬ 
ity  representations  for  people  within  the  organization.  For 
example,  although  anyone  has  the  capability  to  call  a  taxi 
for  a  visitor  (and  will  do  so  if  necessary),  project  assistants 
are  the  preferred  option.  Depending  on  upcoming  deadlines, 
a  researcher  may  be  capable  but  not  willing  to  participate  in 
a  visitor’s  schedule.  Extensions  to  the  language  are  needed 
to  express  additional  properties  of  agents,  such  as  reliability, 
efficiency,  and  invocation  guidelines. 

Reliable  Access  to  Information 

Timely  access  to  up-to-date  information  is  crucial  to  the 
successful  planning  and  execution  of  tasks  in  the  Electric 
Elves  organization.  Agents  making  decisions  on  behalf  of 
human  users  need  to  extract  information  from  multiple  het¬ 
erogeneous  information  sources,  including  organizational 
databases  (personal  schedules,  staff  lists)  and  external  Web 
sites,  such  as  airline  schedules,  restaurant  information,  traf¬ 
fic  and  weather  updates,  etc.  In  order  to  pick  a  restaurant 
for  a  scheduled  lunch  meeting,  the  agents  access  the  Restau¬ 
rant  Row  site  to  get  the  locations  of  restaurants  that  meet  the 
specified  criteria,  e.g.,  dietary  restrictions.  Wrappers  enable 
Web  sources  to  be  queried  as  if  they  were  databases  by  other 
applications,  such  as  the  Electric  Elves  agents.  A  critical 
part  of  a  wrapper  is  a  set  of  extraction  rules  that  enable  the 
wrapper  to  quickly  locate  the  beginning  and  end  of  the  data 
to  be  extracted  from  a  Web  page  in  response  to  some  query. 

The  Ariadne  component  (Knoblock  et  al.  2000;  2001)  of 
Electric  Elves  learns  wrappers  from  pages  in  which  relevant 
data  has  been  labeled  by  the  user.  Previous  research  has  fo¬ 
cused  on  applying  machine  learning  techniques  to  rapidly 
generate  wrappers  (Muslea,  Minton,  &  Knoblock  2000; 
Kushmerick  2000),  but  few  attempts  have  been  made  to  val¬ 
idate  data,  detect  failures  (Kushmerick  1999)  or  repair  wrap¬ 
pers  when  the  source  pages  change  in  a  way  that  breaks 
the  wrapper.  Automatically  monitoring  external  information 
sources  and  repairing  wrappers  when  errors  are  detected  is  a 
critical  part  of  a  robust  dynamic  organization. 

We  address  the  problem  of  wrapper  verification  by  apply¬ 
ing  machine  learning  techniques  to  learn  a  set  of  patterns 
that  describe  the  content  of  the  extracted  data.  Since  the  in¬ 
formation  for  a  single  data  field  can  vary  considerably,  the 
system  learns  a  statistical  distribution  of  patterns.  Wrappers 
can  be  verified  by  comparing  newly  extracted  data  to  the 
learned  patterns.  When  a  significant  difference  is  found,  we 
can  launch  the  wrapper  repair  process. 

The  learned  patterns  represent  the  structure  of  data  as  a 
sequence  of  words  and  wildcards.  Wildcards  represent  syn¬ 
tactic  categories  to  which  words  belong — alphabetic,  nu¬ 
meric,  capitalized,  etc.  Eor  example,  a  set  of  street  addresses 
all  start  with  a  pattern  “JVumber_  Capitalized  a  number 
followed  by  a  capitalized  word.  The  algorithm  we  devel¬ 
oped  (Lerman  &  Minton  2000)  finds  all  statistically  signif¬ 
icant  starting  and  ending  patterns  in  a  set  of  positive  exam¬ 
ples  of  the  data  field.  A  pattern  is  significant  if  it  occurs 
more  frequently  than  would  be  expected  by  chance  if  the 
tokens  were  generated  randomly  and  independently  of  one 
another.  Our  approach  is  similar  to  work  on  grammar  induc¬ 
tion  (Carrasco  &  Oncina  1994),  but  our  pattern  language  is 


better  suited  for  capturing  the  regularities  in  small  data  fields 
(as  opposed  to  languages).  Eor  verification,  we  learn  the  pat¬ 
terns  from  training  examples  (data  extracted  by  the  wrapper 
that  is  known  to  be  correct).  Next,  the  wrapper  generates  a 
set  of  test  examples  from  pages  retrieved  using  the  same  or 
similar  set  of  queries.  If  the  patterns  describe  statistically  the 
same  proportion  of  the  test  examples  as  the  training  exam¬ 
ples,  the  wrapper  is  deemed  correct;  otherwise,  it  has  failed. 

The  most  common  causes  of  wrapper  failure  are  changes 
in  Web  site  layout.  Even  minor  changes  can  break  the  wrap¬ 
per’s  data  extraction  rules.  However,  since  the  content  tends 
to  remain  the  same,  it  is  often  possible  to  automatically  re¬ 
pair  the  wrapper  by  learning  new  extraction  rules.  We  ex¬ 
ploit  the  learned  patterns  to  find  correct  examples  of  data  on 
the  new  pages.  The  Restaurant  Row  wrapper  allows  us  to  re¬ 
trieve  several  examples  of  restaurant  addresses,  and  the  ver¬ 
ification  algorithm  learned  that  some  of  the  examples  start 
with  the  pattern  “JVumber_  Capitalized  1’  and  end  with  the 
pattern  “Avenue”.  If  Restaurant  Row  changes  to  look  more 
like  the  Zagat  Web  site,  the  wrapper  will  no  longer  extract 
addresses  correctly.  In  the  verification  phase  we  will  detect 
the  failure  because  the  extracted  data  is  not  described  by  the 
patterns.  However,  since  restaurant  addresses  still  start  with 
“JVumber_  Capitalized!’  and  end  with  “Avenue”,  we  should 
be  able  to  find  addresses  on  the  changed  pages.  Once  the 
desired  information  has  been  found,  these  examples  and  the 
new  pages  are  sent  to  the  wrapper  generation  system  to  learn 
new  data  extraction  rules.  We  use  prior  knowledge  about  the 
content  of  data,  as  captured  by  the  learned  patterns,  along 
with  a  priori  expectations  about  the  data  to  identify  correct 
examples  on  the  changed  pages.  We  can  expect  the  same 
data  field  to  appear  in  roughly  the  same  position  and  in  a 
similar  context  on  each  page;  moreover,  we  expect  at  least 
some  of  the  data  to  remain  unchanged.  Of  course,  some  in¬ 
formation,  e.g.,  traffic  and  flight  arrivals,  changes  on  a  reg¬ 
ular  basis,  though  we  may  still  rely  on  patterns  to  identify 
it. 

Our  approach  can  be  extended  to  automatically  create 
wrappers  for  new  information  sources  using  data  extracted 
from  a  known  source.  Thus,  once  we  learn  what  restaurant 
addresses  look  like,  we  can  use  this  information  to  extract 
addresses  from  any  yellow  pages-type  source,  and  use  it  to 
create  a  wrapper  for  this  source. 

Knowledge  from  Unstructured  Sources 

As  mentioned  above,  an  agent-assisted  organization  cru¬ 
cially  depends  on  access  to  accurate  and  up-to-date  informa¬ 
tion  about  the  humans  it  supports  as  well  as  the  environment 
in  which  they  operate.  Some  of  this  information  can  be  pro¬ 
vided  directly  from  existing  databases  and  online  sources, 
but  other  information — ^people’s  expertise,  capabilities,  in¬ 
terests,  etc. — will  often  not  be  available  explicitly  and  might 
need  to  be  modeled  by  hand.  In  a  dynamic  environment 
such  as  Electric  Elves,  however,  manual  modeling  is  only 
feasible  for  relatively  static  information.  Eor  example,  if  at 
some  conference  we  want  to  select  potential  candidates  for 
a  lunch  meeting  with  Yolanda  Gil  based  on  mutual  research 
interests,  it  is  not  feasible  to  manually  model  relevant  knowl¬ 
edge  about  each  person  on  the  conference  roster  before  such 


a  selection  can  be  made. 

To  support  team-building  tasks  such  as  inviting  people  for 
a  lunch  meeting,  finding  people  potentially  interested  in  a 
presentation  or  research  meeting,  finding  candidates  to  meet 
with  a  visitor,  etc.,  we  developed  a  matchmaking  service 
called  the  Interest  Matcher.  It  can  match  people  based  on 
their  research  interests  but  also  take  other  information  into 
account  such  as  involvement  in  research  projects,  present 
and  past  affiliation,  universities  attended,  etc.  To  minimize 
the  need  for  manual  modeling  in  a  dynamic  environment,  we 
combined  statistical  match  techniques  from  the  area  of  infor¬ 
mation  retrieval  (IR)  with  logic-based  matching  performed 
by  the  PowerLoom  knowledge  representation  (KR)  system. 
The  IR  techniques  work  well  with  unstructured  text  sources 
available  online  on  the  Web,  which  is  the  form  in  which 
information  is  typically  available  to  outside  organizations. 
PowerLoom  facilitates  declarative  modeling  of  the  decision 
process,  modeling  of  missing  information,  logical  inference, 
explanation  and  customization. 

The  matchmaker  is  built  on  top  of  the  PowerLoom  KR 
system,  which  is  the  successor  to  Loom.  PowerLoom  uses 
a  variant  of  KIF  (Genesereth  1991)  as  its  language,  and  its 
inference,  explanation  and  partial-match  capabilities  are  im¬ 
portant  to  support  the  matchmaking  task.  PowerLoom’s  in¬ 
ference,  explanation  and  partial-match  capabilities  are  im¬ 
portant  to  support  the  matchmaking  task.  The  matchmaker’s 
knowledge  base  contains  an  ontology  of  research  topic  areas 
and  associated  relations;  rules  formalizing  the  matchmaking 
process;  and  manually  modeled,  relatively  static  informa¬ 
tion  about  staff  members,  research  projects,  etc.  To  perform 
a  particular  matchmaking  task,  a  requesting  agent  sends  a 
message  containing  an  appropriate  PowerLoom  query  to  the 
Interest  Matcher.  For  example,  the  following  query  finds 
candidates  for  lunch  with  Yolanda  Gil; 

(retrieve  all  ?x  (should-meet  ?x  Gll)) 

The  should-meet  relation  and  one  of  its  supporting  relations 
are  defined  as  follows  in  PowerLoom: 

(defrelation  should-meet  ((?p1  Person)  (?p2  Person)) 

:<;=  (or  (interests-overlap  ?p1  ?p2) 

(institution-in-common  ?p1  ?p2) 

(school-in-common  ?p1  ?p2))) 

(defrelation  interests-overlap  ((?p1  Person)  (?p2  Person)) 

:<;=  (exists  (?interest1  ?interest2) 

(and  (research-interest  ?p1  ?interest1) 

(research-interest  ?p2  ?interest2) 

(or  (subset-of  ?interest1  ?interest2) 

(subset-of  ?interest2  ?interest1 ))))) 

For  more  specific  purposes,  any  of  the  more  basic  re¬ 
lations  comprising  should-meet  such  as  Interests-everlap 
could  be  queried  directly  by  a  client.  Using  a  general  pur¬ 
pose  KR  system  as  the  matching  engine  provides  us  with  this 
flexibility.  Note,  that  for  Interests-overlap  we  only  require  a 
subsumption  relationship,  e.g.,  interest  in  planning  would 
subsume  (or  overlap  with)  interest  in  hierarchical  planning. 

To  answer  the  query  above,  the  matchmaker  generates  the 
set  of  people  in  its  knowledge  base  satisfying  the  should- 
meet  relation  and  returns  it  as  a  result  (usually,  the  candidate 


set  is  further  constrained  and  does  not  include  everybody  in 
the  KB).  In  an  ideal  world,  the  matchmaking  KB  would  be 
complete.  In  the  real  world,  this  will  usually  not  be  the  case, 
particularly  when  the  organization  interacts  with  outsiders 
such  as  conference  attendees.  To  deal  with  incompleteness 
of  the  KB,  we  allow  a  requesting  agent  to  introduce  new  in¬ 
dividuals  and  then  the  Interest  Matcher  automatically  infers 
limited  structured  knowledge — their  research  interests — ^by 
analyzing  relevant  unstructured  text  sources  on  the  Web. 

The  key  idea  is  that  people’s  research  interests  are  im¬ 
plicitly  documented  in  their  publication  record.  We  make 
these  interests  explicit  by  associating  each  research  topic  in 
the  PowerLoom  topic  ontology  with  a  statistical  representa¬ 
tion  of  a  set  of  abstracts  of  research  papers  representative  of 
the  topic.  These  topic  sets  are  determined  automatically  by 
querying  a  bibliography  search  engine  such  as  Cora  or  the 
NEC  Researchindex  with  seed  phrases  representative  of  the 
topic  (access  to  such  Web  sources  is  facilitated  by  Ariadne 
wrappers).  We  then  query  the  same  search  engine  for  pub¬ 
lication  abstracts  of  a  particular  researcher  and  then  classify 
them  by  computing  statistical  similarity  measures  between 
the  researcher’s  publications  and  the  topic  sets  determined 
before.  When  the  similarity  surpasses  an  empirically  deter¬ 
mined  threshold,  an  appropriate  interest  assertion  is  added  to 
the  matchmaker  KB  that  can  then  be  exploited  in  the  match¬ 
making  process  described  above. 

We  use  a  standard  IR  vector  space  model  to  represent  doc¬ 
ument  abstracts  and  compute  similarity  by  a  cosine  measure 
and  by  weighting  terms  based  on  how  well  they  signify  par¬ 
ticular  topic  classes  (Salton  &  McGill  1983).  We  also  use 
our  own  aggressive  stemmer  to  reduce  the  number  of  fea¬ 
tures  that  need  to  be  considered  for  similarity  computations. 
The  dynamic  derivation  of  interests  from  unstructured  on¬ 
line  sources  sets  our  approach  apart  from  the  one  described 
in  (Sycara  &  Zeng  1996)  that  relies  solely  on  manually  spec¬ 
ified  interests. 

Extending  KR  with  IR  can  increase  robustness  for  the 
case  of  an  incomplete  topic  ontology,  since  we  can  use  a 
direct  statistical  match  of  researchers’  publications.  Con¬ 
versely,  IR  matching  can  benefit  from  KR  matching  in 
cases  where  two  researchers  do  not  have  similar  publication 
records  but  can  be  related  via  similarity  to  a  common  or  hier¬ 
archically  related  topic.  The  smooth  combination  of  statisti¬ 
cal  and  logical  reasoning  is  a  non-trivial  problem,  however, 
and  still  provides  room  for  further  research  and  improve¬ 
ment. 

Coordination  of  Component  Agents 

The  diverse  agents  in  Electric  Elves  must  work  together  to 
accomplish  the  complex  tasks  of  the  whole  system.  Eor  in¬ 
stance,  to  plan  a  lunch  meeting,  the  interest  matcher  finds 
a  list  of  potential  attendees,  the  Eriday  of  each  potential 
attendee  decides  whether  s/he  will  attend,  the  capability 
matcher  identifies  dietary  restrictions  of  the  confirmed  at¬ 
tendees,  and  the  reservation  site  wrapper  identifies  possible 
restaurants  and  makes  the  final  reservation.  In  addition  to 
low-level  communication  issues,  there  is  the  complicated 
problem  of  getting  all  these  agents  to  work  together  as  a 
team.  Each  of  these  agents  must  execute  its  part  in  coor- 


dination  with  the  others,  so  that  it  performs  its  tasks  at  the 
correct  time  and  sends  the  results  to  the  agents  who  need 
them. 

However,  constructing  teams  of  such  agents  remains  a 
difficult  challenge.  Current  approaches  to  designing  agent 
teams  lack  the  general-purpose  teamwork  models  that  would 
enable  agents  to  autonomously  reason  about  the  commu¬ 
nication  and  coordination  required.  The  absence  of  such 
teamwork  models  makes  team  construction  highly  labor- 
intensive.  Human  developers  must  provide  the  agents  with  a 
large  number  of  problem-specific  coordination  and  commu¬ 
nication  plans  that  are  not  reusable.  Furthermore,  the  result¬ 
ing  teams  often  suffer  from  a  lack  of  robustness  and  flexibil¬ 
ity.  In  a  real-world  domain  like  Electric  Elves,  teams  face  a 
variety  of  uncertainties,  such  as  a  member  agent’s  unantic¬ 
ipated  failure  in  fulfilling  responsibilities  (e.g.,  a  presenter 
is  delayed),  members’  divergent  beliefs,  and  unexpectedly 
noisy  communication.  It  is  difficult  to  anticipate  and  pre¬ 
plan  for  all  possible  coordination  failures. 

In  Electric  Elves,  the  agents  coordinate  using  Teamcore, 
a  domain-independent,  decentralized,  teamwork-based  inte¬ 
gration  architecture  (Pynadath  et  al.  1999).  Teamcore  uses 
STEAM,  a  general-purpose  teamwork  model  (Tambe  1997) 
and  provides  core  teamwork  capabilities  to  agents  by  wrap¬ 
ping  them  with  Teamcore  proxies  (separate  from  the  Eriday 
agents  that  are  user  proxies).  By  interfacing  with  Team- 
core  proxies,  existing  agents  can  rapidly  assemble  them¬ 
selves  into  a  team  to  solve  a  given  problem.  The  Teamcore 
proxies  form  a  distributed  team-readiness  layer  that  provides 
the  following  social  capabilities:  (i)  coherent  commitment 
and  termination  of  joint  goals,  (ii)  team  reorganization  in  re¬ 
sponse  to  member  failure,  (iii)  selective  communication,  (iv) 
incorporation  of  heterogeneous  agents,  and  (v)  automatic 
generation  of  tasking  and  monitoring  requests.  Although 
other  agent-integration  architectures  such  as  OAA  (Mar¬ 
tin,  Cheyer,  &  Moran  1999)  and  RETSINA  (Sycara  et  al. 
1996)  provide  capability  (iv),  Teamcore’s  use  of  an  explicit, 
domain-independent  teamwork  model  allows  it  to  support 
all  five  required  social  capabilities. 

Every  agent  in  the  Electric  Elves  organization  (Eridays, 
matchers,  wrappers)  has  an  associated  Teamcore  proxy  that 
records  its  membership  in  various  teams  and  active  commit¬ 
ments  made  to  these  teams.  Given  an  abstract  specification 
of  the  organization  and  its  plans,  the  Teamcore  proxies  au¬ 
tomatically  execute  the  necessary  coordination  tasks.  They 
form  joint  commitments  to  team  plans  such  as  holding  meet¬ 
ings,  hosting  and  meeting  with  visitors,  arranging  lunches, 
etc.  Teamcore  proxies  also  communicate  amongst  them¬ 
selves  to  ensure  coherent  and  robust  plan  execution.  The 
Teamcore  proxies  automatically  substitute  for  missing  roles 
(e.g.,  if  the  presenter  is  absent  from  the  meeting)  and  inform 
each  other  of  critical  factors  affecting  a  team  plan.  Einally, 
they  communicate  with  their  corresponding  agents  to  mon¬ 
itor  the  agents’  ability  to  fulfill  commitments  (e.g.,  asking 
Eriday  to  monitor  its  user’s  attendance  of  a  meeting)  and  to 
inform  the  agents  of  changes  to  those  commitments  (e.g., 
notifying  Eriday  of  a  meeting  rescheduling). 


Electric  Elves  Architecture 

Electric  Elves  is  a  complex  and  heterogeneous  system  span¬ 
ning  a  wide  variety  of  component  technologies  and  lan¬ 
guages,  communication  protocols  as  well  as  operating  sys¬ 
tem  platforms.  Eigure  2  shows  the  components  of  the  current 
version  of  Electric  Elves.  Teamcore  agents  are  written  in 
Python  and  Soar  (which  is  written  in  C),  Ariadne  wrappers 
are  written  in  C-H-,  the  PHOSPHORUS  capability  matcher 
is  written  in  Common-Lisp  and  the  PowerLoom  interest 
matcher  is  written  in  STELLA  (Chalupsky  &  MacGregor 
1999)  which  translates  into  Java.  The  agents  are  distributed 
across  SunOS  5.7,  Windows  NT,  Windows  2000  and  Linux 
platforms,  and  use  TCP/IP,  HTTP  and  the  Lockheed  KQML 
API  to  handle  specialized  communication  needs. 

Tying  all  these  different  pieces  together  in  a  robust  and 
coherent  manner  constitutes  a  significant  engineering  chal¬ 
lenge.  Initially  we  looked  for  an  implementation  of  KQML, 
but  there  was  none  available  that  supported  all  the  languages 
and  platforms  we  required.  To  solve  this  integration  prob¬ 
lem,  we  are  using  the  DARPA  supported  CoABS  Grid  tech¬ 
nology  developed  by  Global  InfoTek,  Inc.  and  ISX  Corpo¬ 
ration'.  The  CoABS  Grid  is  a  Java-based  communication 
infrastructure  built  on  top  of  Sun’s  Jini  networking  technol¬ 
ogy.  It  provides  message  and  service-based  communication 
mechanisms,  agent  registration,  lookup  and  discovery  ser¬ 
vices,  as  well  as  message  logging,  security  and  visualization 
facilities.  Since  it  is  written  in  Java,  it  runs  on  many  OS 
platforms,  and  it  is  relatively  easy  to  connect  with  non-Java 
technology.  Grid  proxy  components  connect  non- Java  tech¬ 
nology  to  the  Grid. 

We  primarily  use  the  CoABS  Grid  as  a  uniform  trans¬ 
port  mechanism.  The  content  of  Grid  messages  are  in 
KQML  format  and  could  potentially  be  communicated  via 
alternative  means.  Not  all  Electric  Elves  message  traffic 
goes  across  the  Grid.  Eor  example,  the  Teamcore  agents 
communicate  via  their  own  protocol  (the  Lockheed  KQML 
API)  and  only  use  the  Grid  to  communicate  with  non- 
Teamcore  agents  such  as  the  capability  and  interest  match¬ 
ers.  Similarly,  the  information  retrieval  engine  communi¬ 
cates  with  Ariadne  wrappers  directly  via  HTTP  instead  of 
going  through  the  Grid. 

In  general,  our  experience  with  the  CoABS  Grid  has  been 
very  positive.  It  is  reasonably  robust  and  up  to  the  task  of 
24/7  operation  (since  June  2000  we  have  logged  over  40,000 
Grid  messages).  The  Grid  has  provided  us  with  basic  inter¬ 
operability  that  would  have  been  difficult  to  achieve  other¬ 
wise.  Initially  we  looked  for  an  alternative  communication 
solution  such  as  using  some  implementation  of  KQML,  but 
none  satisfied  all  the  different  language,  OS  platform  and 
protocol  requirements.  The  synergies  that  resulted  in  part 
from  this  basic  interoperability  provided  by  the  CoABS  Grid 
are: 

♦  Simple  access  to  Ariadne  Web  wrappers  motivated  the 

connection  of  IR  with  KR  techniques  for  the  purpose  of 

the  Interest  Matcher. 

♦  Access  to  the  PHOSPHORUS  capability  matchmaker 

provides  Teamcore  agents  with  sophisticated  capability 

Tttp :  //coabs  .  global  inf  otek .  com/coabs4)ublic/coabs_pdf  /gridvision .  pdf 
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Figure  2:  Electric  Elves  System  Architecture 


reasoning  that  allows  assembly  of  more  efficient  teams 
for  particular  tasks. 

♦  Similarly,  by  using  Ariadne  wrappers  for  Meeting  Maker 
scheduling  software,  flight  tracking,  restaurant  selection, 
etc.,  Teamcore  agents  can  access  a  much  richer  infor¬ 
mation  sphere  and  support  more  complex  and  interesting 
tasks  than  otherwise  possible. 

Related  Work 

Several  agent-based  systems  have  been  developed  that  sup¬ 
port  specific  tasks  within  an  organization,  such  as  meeting 
scheduling  (Dent  et  al.  1992)  and  visitor  hosting  (Kautz  et 
al.  1994;  Sycara  &  Zeng  1994).  In  contrast  to  these  systems, 
we  believe  that  our  approach  integrates  a  range  of  technolo¬ 
gies  that  can  support  a  variety  of  tasks  within  the  organi¬ 
zation.  Agent  architectures  have  been  applied  to  organiza¬ 
tional  tasks  (Sycara  et  al.  1996;  Martin,  Cheyer,  &  Moran 
1999;  Lesser  et  al.  1999),  but  none  of  them  include  technol¬ 
ogy  for  teamwork,  adjustable  autonomy,  and  dynamic  col¬ 
lection  of  information  from  external  sources. 

To  our  knowledge.  Electric  Elves  represents  the  first 
agent-based  system  that  is  used  for  routine  tasks  within  a 
human  organization.  Several  other  areas  of  research  have 
looked  at  complementary  aspects  of  the  problems  that  we 
aim  to  address.  Research  on  architectures  and  systems  for 
Computer-Supported  Cooperative  Work  include  a  variety 
of  information  management  and  communication  technolo¬ 
gies  that  facilitate  collaboration  within  human  organizations 
(Greenberg  1991;  Malone  et  al.  1997).  In  contrast  with  our 
work,  they  do  not  have  agents  associated  with  people  that 
have  some  degree  of  autonomy  and  can  make  decisions  on 
a  human’s  behalf.  Our  work  is  also  complementary  and  can 
be  extended  with  ongoing  research  on  ubiquitous  comput¬ 
ing  and  intelligent  buildings  (Lesser  et  al.  1999).  These 


projects  are  embedding  sensor  networks  and  agents  to  con¬ 
trol  and  improve  our  everyday  physical  environments.  This 
kind  of  infrastructure  would  make  it  easier  for  Electric  Elves 
to  locate  and  contact  people  as  well  as  to  direct  the  environ¬ 
mental  control  agents  in  support  of  organizational  tasks. 

Current  Status 

The  Electric  Elves  system  has  been  in  use  within  our  re¬ 
search  group  at  ISI  since  June  1,  2000;  and  operating  con¬ 
tinuously  24  hours  a  day,  7  days  a  week  (with  interruptions 
for  bug  Axes  and  enhancements).  Usually,  nine  agent  prox¬ 
ies  are  working  for  nine  users,  with  one  proxy  each  for  a  ca¬ 
pability  matcher  and  an  interest  matcher.  The  proxies  com¬ 
municate  with  their  users  using  a  variety  of  devices:  work¬ 
station  display,  voice,  mobile  phones,  and  palm  pilots.  They 
also  communicate  with  restaurants  by  sending  faxes. 

Eigure  3  plots  the  number  of  daily  messages  exchanged 
by  the  proxies  for  seven  months  (June  1,  2000  to  Decem¬ 
ber  31,  2000).  The  size  of  the  daily  counts  demonstrates  the 
large  amount  of  coordination  actions  necessary  in  managing 
all  of  the  activities  such  as  meeting  rescheduling.  The  high 
variability  reflects  the  fluctuation  in  the  number  of  daily  ac¬ 
tivities,  e.g.,  weekends  and  long  breaks  such  as  the  Christ¬ 
mas  break  usually  have  very  little  activity.  Eurthermore, 
with  continually  increasing  system  stability,  the  amount  of 
housekeeping  activity  necessary  has  reduced  automatically. 

Several  observations  show  the  effectiveness  of  Electric 
Elves.  Eirst,  over  the  past  several  months,  few  emails  have 
been  exchanged  among  our  group  members  indicating  to 
each  other  that  they  may  get  delayed  to  meetings.  In¬ 
stead,  Eriday  agents  automatically  address  such  delays.  In 
addition,  the  overhead  of  waiting  for  delayed  members  in 
meeting  rooms  has  been  reduced.  Overall,  1128  meetings 
have  been  monitored,  out  of  which  285  have  been  resched- 


Date 


Figure  3:  Number  of  daily  coordination  messages  ex¬ 
changed  by  proxies  over  a  seven-month  period. 

uled,  230  automatically  and  55  by  hand.  Both  autonomous 
rescheduling  and  human  intervention  were  useful  in  Elves. 

Furthermore,  whereas  in  the  past,  one  of  our  group  mem¬ 
bers  would  need  to  circulate  emails  trying  to  recruit  a  pre¬ 
senter  for  research  meetings  and  making  announcements, 
this  overhead  has  almost  completely  vanished — weekly  auc¬ 
tions  automatically  select  the  presenters  at  our  research 
meetings.  These  auctions  are  automatically  opened  when 
the  system  receives  notification  of  any  meeting  requiring  a 
presentation.  A  summary  of  the  results  is  in  Table  1  be¬ 
low.  Column  1  shows  the  dates  of  the  research  presenta¬ 
tions.  While  the  auctions  are  held  weekly,  several  weekly 
meetings  over  this  summer  were  cancelled  due  to  confer¬ 
ence  travel  and  vacations.  Column  2  shows  the  total  num¬ 
ber  of  bids  received  before  a  decision.  The  key  here  is  that 
auction  decisions  may  be  made  with  fewer  than  nine  bids; 
in  fact,  in  one  case,  only  four  bids  were  received.  The  rest 
of  the  group  simply  did  not  bid  before  the  winner  was  an¬ 
nounced.  Column  3  shows  the  winning  bid.  A  winner  typi¬ 
cally  bid  <  1 , 1  >  indicating  that  the  user  it  represents  is  both 
capable  and  willing  to  do  the  presentation.  Interestingly,  the 
winner  of  July  27  had  a  bid  of  <0,1>:  not  capable  but  will¬ 
ing.  The  proxy  team  was  able  to  settle  on  a  winner  despite 
the  bid  not  being  the  highest  possible,  illustrating  its  flex¬ 
ibility.  Note  that  the  capability  bids  for  these  auctions  are 
obtained  by  querying  the  PHOSPHORUS  matchmaker.  Fi¬ 
nally,  column  4  shows  the  results.  In  six  of  the  eight  times, 
winner  was  automatically  selected.  However,  on  two  occa¬ 
sions  (July  6  and  Sept  19)  exceptional  circumstances  (e.g.,  a 
visitor)  required  human  intervention,  which  our  proxy  team 
easily  accommodates. 

Other  benefits  of  Electric  Elves  includes  a  web  page, 
where  different  Friday  agents  post  their  user’s  location,  en¬ 
ables  us  to  track  our  group  members  quickly;  again,  avoid¬ 
ing  the  overhead  of  trying  to  track  them  down  manually. 

Discussion 

As  described  in  this  paper  we  have  successfully  deployed  the 
Electric  Elves  in  our  own  real-world  organization.  These 


Date 

#  of  bids 

Winner<bid> 

Autonomous? 

July  6 

7 

Scerri<l,l> 

No 

July  20 

9 

Scerri<l,l> 

Yes 

July  27 

7 

Kulkarni<0, 1  > 

Yes 

August  3 

8 

Nair<l,l> 

Yes 

August  3 1 

4 

Tambe<l,l> 

Yes 

Sept  19 

6 

Visitor<-,-> 

No 

Oct  31 

7 

Tambe<l,l> 

Yes 

Nov  21 

7 

Nair<l,l> 

Yes 

Table  1 ;  Results  for  auctioning  research  presentation  slot. 


agents  interact  directly  with  humans  both  within  the  or¬ 
ganization  and  outside  the  organization  communicating  by 
email,  wireless  messaging,  and  faxes.  Our  agents  go  beyond 
simply  automating  tasks  that  were  previously  performed  by 
humans.  Because  hardware  and  processing  power  is  cheap, 
our  agents  can  perform  a  level  of  monitoring  that  would 
be  impractical  for  human  assistants,  ensuring  that  activi¬ 
ties  within  an  organization  run  smoothly  and  that  events  are 
planned  and  coordinated  to  maximize  the  productivity  of  the 
individuals  of  an  organization. 

In  the  process  of  building  the  applications  described  in 
this  paper,  we  addressed  a  number  of  key  technology  prob¬ 
lems  that  arise  in  any  agent-based  system  applied  to  hu¬ 
man  organizations.  In  particular  we  described  how  to  use 
Markov  Decision  Processes  to  determine  the  appropriate  de¬ 
gree  of  autonomy  for  the  agents,  how  to  use  knowledge- 
based  matchmaking  to  assign  tasks  within  an  organization, 
how  to  apply  machine  learning  techniques  to  ensure  robust 
access  to  the  data  sources,  how  to  combine  knowledge-based 
and  statistical  matchmaking  techniques  to  derive  knowledge 
about  the  participants  both  within  and  outside  an  organiza¬ 
tion,  and  how  to  apply  multi-agent  teamwork  coordination 
to  dynamically  assemble  teams. 

There  are  a  huge  number  of  possible  applications  of  this 
work.  We  plan  to  continue  to  both  extend  the  range  of  ap¬ 
plications  and  the  underlying  technologies  for  building  the 
agents.  One  of  the  advantages  of  deploying  the  research  in 
our  own  organization  is  that  there  is  no  shortage  of  ideas  for 
future  tasks  for  the  Electric  Elves  to  perform. 
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